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FOREWORD 



The NGDHDiviaoh of Attoim^m^Sei^fces^Reiear^ in toc^efafibn wiih the CDPI 
Dhraontfpumcu^^ 

of basic slafis lor jplibliic school snidentsln Grades 3,^ 

Science and Social Studies for students in Grades ^ and 8; ~and high-school course 
acMevement tests for students taidnjg Algebra \ JM^tea^ -IKb^^ t^^k&^ry» 'En^l^l- , ], 
Geonietry> Physics, and U.S. History. Physical Soence and Economic, tegal, and Political 
Systems vwll be added in 199i, and o&ot 

To facilitate theproper technical use of me test scores obtainedfrom the administration of the 
tests, the cuMcular and psychometric characteristics of the tests are described in aseries of 
technical manuals. This manual, the eighth in the series, contains a description of tlie 
characteristics of the North Carolina Test of Geometry. 



•Readers who have an interest in the origins of the test development program are referred to the North Carolina 
Elementary and Secondary Reform Act of 1984, the North QrolinaBasicEducatiohProgram,theNorth Carolina 
Standard Course of Study, and the Teacher Handbook. 
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Description 



TheNorth Carolina Test of Geometry (NCT-Geometry) was developed for use as an achievement 
test following the completion of the Geometry course of study. Its design serves a dual 
purpose: that of a normative measurement of student achievement and thai of an objective- 
based measurement of curriculum coverage. 

The measurement of student achievement is attained by administering a set of items based on 
a basic core of 55 objectives and a set of five objectives selected randomly from 10 variable 
objectives (one item per objective tested). This test design wasnecessitated because of a large 
number of objectives to be covered in a limited administration time. The measurement of 
curriculum is met by the same set of items that cover the basic set of objectives taught in the 
Geometry course of instruction. Four forms of the test are administered in each classroom, one 
form per student, tinder this system, a fourth of the students in the classroom will take Form 
1 of the test, a fourth will take Form 2, and so on (see Table 1). 



Table 1 

Organization of the North Carolina Test of Geometry 




55 Basic Objectives 




5 Variable 


5 Variable 


5 Variable 


5 Variable 


Objectives 


Objectives 


Objectives 


Objectives 


60 Items 
Forml 


60 Items 
Form 2 


60 Items 
Form 3 


60 Items 
Form 4 



The normative student scores are based on the 60-item total score. Curriculum assessment is 
achieved by combining the results from all four forms of the test administered at one time for 
a total of 240 items. 
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Validity 



The development of a Geometry achievement test has- two purposes. The first, is* to obtain, 
scores from which inferences may be drawn conosnung the degree oksuccess a> particular 
student> classroom, school, or school district-has had;in;masterirtg the Geometty. curriculum. 
The second is to assess the degree to which- the curriailum has been mastered: by students in 
the aggregate. To the extent this can be done meaningfully, test scores may be saidifo be valid. 
Thus, one inference drawn from a test-score may be valid> while another may not 

Theoreticians state that only inferences concerning test scores may be said to have validity. 
Generally, readers understand this, and this manual will employ the convenient shorthand of 
speaking about "tes* validity" rather than "inferences-about achievement drawn from scores 
obtained from tests/' 

Tv.st validity is a predominant theme in test development, from. the time the idea for a test is 
conceived until the final test scores have been analyzed and interpreted. The validity of a test 
concerns what the test measures and how well it does so. For convenience, the various 
components of test validity will be described as if they were unique, independent components 
rather than interrelated parts. The first component of test validity to be described will be 
auricular validity. 

Curricula validity 

If a test is to be used to measure the degree to which a course of study has been mastered, the 
first step is to define the curriculum. In the case of Geometry, this was done through a 
cooperative effort, led by NCDPI Program Services/Division of Curriculum and Instruction 
Services, involving curriculum specialists, teachers, administrators, university professors, and 
others. The result was a list of 14 goals encompassing 97 objectives (see Appendices A and B). 
Supported by expert opinion and a statewide consensus, these goals and objectives were 
approved by the State Board of Education in 1985 as the basis for instruction in Geometry. 
Curricular validity, the first step in establishing test validity, was established by this method. 

Instructional validity 

A basic courseof study may not include all of the objectives taught under various circumstances 
in Geometry. For example, some advanced classes may cover material that would be beyond 
the reach of 95% of all Geometry students. For this reason, it becomes important to know just 
what is being taught in the majority of Geometry classes in the state. To determine this, all 
Geometry teachers in North Carolina were surveyed in May 1986 (N ■ 915). The analysis of 
results was based on 749 responses, or 82% of all possible responses. 
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The Geometry teachers examined the 97 objectives and noted whether they taught each 
objective every year and whether each objective *vas basic to instruction. Of the objectives, 86 
were rated as basic to instruction by at least 50% of the responding teachers. After deliberation 
by curriculum spedalists,22of theGeometry objectives wereremoved from further assessment 
for various, reasons (for example, they involved geometric constructions or they concerned 
advanced topics in coordinate geometry). During the item writing process it was determined 
that one goal encompassing seven objectives (geometric constructions) and three other 
objectives (two-column fbrmatproofe,m^ should 
not be assessed by a multiple-choice achievement test. It was determined that the remaining 
13 goals and 65 objectives formed the basic curriculum for Geometry. 

The objectives used in test development are listed in Appendix A and the objectives that wei e 
rejected for use are listed in Appendix B, together with tK* proportion of teachers judging each 
one as basic. 

Instructional validity, the second step in defining test validity, was established by these 
procedures. It defines the inferences that can be drawn from the Geometry scores. 

In summary, it was concluded that curricular and instructional validity depended jointly on 
the 13 goals and 65 objectives under which they were collected and that title Geometry test 
should be built on that foundation. 

Content validity 

Content validity— the degree to which test items reflect the basic instructional program— is a 
quality commonly referenced in evaluating achievpment tests. Content validity is built into a 
test from the beginning, and the procedures relating to the.content validation of the North 
Carolina Test of Geometry are described below. 

Content validity of the item pool. The content validity of the item pool was defined through 
a number of operations: 

First, the item pool for the Geometry test was created in 1987. It was specified that the pool 
would have 750 items, with 10 items per objective. For four objectives, the items to be written 
were specified to be in proof format (3.5 and 3.6 — 10 out of 10 items; 8.2 — * out of 10 items; and 
9.6 — 5 out of 10 items). The items were developed by ten North Carolina Geometry teachers 
trained in the technical aspects of item- writing. The use of classroom teachers from across the 
state helped to insure that instructional validity was maintained, since the items would be 
drawn from their classroom experiences. All total, 721 multiple choice items and 29 proof items 
were written for the Geometry Item pool. 

Second, the item pool was edited for grammar, synta/, psychometric form, linguistic bias, and 
subject area content. Four multiple choice and nine proof items were deleted from the 
Geometry item pool at this time. 
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Third, the item poo? was analyzed by curriculum specialists and classroom teachers to assure 
that fiie items were valid representations of the objectives for which they were written. Each 
item was reviewed by eight classroom teachers — one from each of the educational regions 
across the state. The criteria for evaluating each item included the following: 

• concepraal— objectivematch,fairrepi^ 

single problem, one best answer, common context in foils/eadi foil credible - 

• language— appropriate for age; correct punctuation, spelling, and grammar; lack of 
excess words; no stem/foil clues; no negatives in foils 

• format— logical order of foils; femiliarpresentation style, printsize, and type; correct 
mechanics and appearance; equal foil lengths 

• diagram— necessary, clean, relevant unbiased 

Four multiple choice items were deleted from theGeometry item pool at this time. The 80 items 
written for objectives 10.4and 13.8-13.14dealing with trigonometry and geometricconstructions 
were held for development at a later time. 

Fourth, the items were collected into ten test forms for field testing. Although the forms were 
not the final forms of the North Carolina Test of Geometry, they were organized in such a way 
that the objectives were represented equitably across all forms. Each form contained 72 or 73 
multiple choice items and two proof items. Ten of the multiple choice items were common 
across all forms of the test for the purpose of ability equating should that become necessary. 
Due to the procedure and time involved in scoring the two proof items, the decision was made 
that proofs would be assessed by a separate five-item test administered in the early spring. 
These items will not be discussed further in this manual. 

Fifth, test administration instructions were written, distribution procedures were organized, 
and administrators were trained to conduct the test administration. Thelest admhtistration 
organization used to administer statewide tests in North Cuolina was employed to do the field 
testing. The administration of the field test forms followed the routine eventually expected to 
be used when the test of record was given. 

Sixth, a sample of 7,973 students was selected to take the ten field test forms containing a total 
of 623 items. To insure broad representation, schools were selected from each of the eight 
North Carolina educational regions and were representative of the state based on criteria that 
were judged to be at least partially related to Geometry ability levels— school performance on 
thel987NCT-AlgebraIandNCT-Algebran. The tenfisld tests wereinterleaved in all student 
samples, producing an even spread of ability across all of the tests. Consequently, each item 
was answered by approximately 707 students (the number of students pe? field test form 
ranged from 655 to 744). 

Seventh, the field test data were analyzed using both the classical psychometric model and the 
one-parameter Rasch model (results were generated from the BICAL computer program). 
Eighteen statistics were assembled for each item, i.e., p-value, Rasch difficulty index, adjusted 
Rasch difficulty index, standard error of the mean, fit mean-square, item validity (point- 
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biserial correlation), and the item characteristic curve groupings. Item bias due to gender or 
ethnicity was examined by computing the partial correlation between the item score and 
gender/ethnicity while controlling for total score. 

The item statistics were submitted to computer analysis using a program designed to scan a 
range of statistics for an item and print out an appropriate psychometric notation based on the 
criteria that had been built into the program specifically for Geometry. An item was classified 
as "too hard" if the p-value was less than .30 or as "too easy" if the p-value was greater than 
.93. An item was said to have "weak prediction" if the point-biserial correlation was less than 
.18. Anitem was said tohavean "entrapment choice/' a "marginal top group/' or an 'Inverted 
ICC" if the item characteristic curve groupings displayed certain irregularities. An item was 
said to exhibit potential "gender" bias if the partial correlation with gender was more extreme 
than ± .133, and to exhibit potential "ethnic" bias if the partial correlation with ethnicity was 
more extreme than ± .1375. 

Tne content of Geometry cannot be represented by a single factor. Therefore, maximization of 
item-total (point-biserial) correlations was not a goal of item development. Once an item was 
shown to have at least modest correlation with a corrected total score (.18 or greater) and was 
judged to measure an objective, it was included in the item pool. While this may have reduced 
the potential internal reliability as measuredby coefficient alpln, itincreased the validity of the 
test by allowing fpr an objective factor structure that was not expected to be unitary. 

This information was placed on the item record, which became the basic document to which 
all other records are referred. The item record contains the goal, objective, historical information, 
a copy of the item itself, the item field-test statistics, and the psychometric notations. Each item 
has a separate item record. 

The psychometric notations were reviewed and decisions were made about the adequacy of 
the items. The decisions were then conveyed to curriculum specialists, who also reviewed the 
items and reached a decision about their curricular adequacy. The psychometric and 
curricular decisions concerning the item's adequacy for use in test development were included 
on the item record. 

Of the 623 items field-tested in 1988, 74 (12%) were deleted from the item pool. In content areas, 
these items are usually discarded. In Geometry, it was felt that an analysis of defective items 
was possible, and that the curriculum specialist could revise or rewrite the items to bring them 
within a usable range of values. Of the 74 deleted items, 68 were revised or rewritten for future 
use. The revised items were employed randomly throughout the selection of items for tests in 
order to assure that their effects would fall equally across all forms. The revised Geometry item 
pool contained 617 items for future test development. 

Content vqlidHy Of the tesi . After a consideration of the logistics involved, it was decided 
to prepare eight complete core tests (60 items) for administration in May 1989. Each core test 
was based on a random selection of items frcm the 55 Geometry core objectives, for a total of 
55 items randomly chosen from the approved item pool (one item per objective). The five 
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a SS^T u Were r5ndomi y *°at the) ten variable: oSjedives (one item per 

ob J^ve):Tltus^ 

made earlier* 

Thk meft^of item.seleGtionis stfficx^ 
randomly equivalent T^AnnriitMaq^^ 
becauseitaUowsmeentryof^^^ 
items thatno one c^ a^weror: to 

limited to mpseite^at^ This, 
was determined' by the. analyses of the item* fiekfcese dkfe*,. wfiidn wa* used; tb> verify the; 
P u s y^ metafe ^ d: curricu^ adequacy oftfteitem pooEanditffdir^wfter^item^evisions 
should be made. 

After the 60-item core tests were assembled, meywemi^ewedbyoneoirricul'um supervisor 
and two teachersin each of the eighteclUGationalre^ons:. ^criteria WaluatrngeaTh core- 
test included the following: 

• that the content of the test shouldrefledtheg^^ 

• thattheitemsshouldbedearfy^ 

to the target age level r r 

thatmecontenfsholudbeb^csdmrdationto ' 
and geographic district of the" state- 

• that each item should have one and only one answer that is< right;: however the 
distrarters should appsarplausib^^ 

represented objective 

The ratings of the 1989 North. Carolina Test of Geometry (Cores 1-6) were high, to superior on. 
all of the criteria. r 

Although the initial equating of the core tests depended upon the random selection of items 
from the item pool, thefinal equating was based on thestatistics ob^nedaethe time thefirst 
test of record was administered, (see Table 2).- This second psychometric analysis; described 
next, was used to diminate random, differences among the cores and thus fedHtate the 
precision of measurement from one year to another and from one form to another: 

Standdrdfeato sample. The&stNo 
(Cores l^)adminisfered^^ 

administered to 43,325 North Carolina Geometry students in May 1989; The state norm 
population comprises these 43^25 students. 

The dght forms of the test (Cores 1-8) were interleaved in all dassrooms, and this produced 
an even spread of ability across all of the. forms. The agreement of the mean core tests 

supported the viewthatmeirutidlequamigprc^essdescribedabovewassuccess^ 
2 and 3). 



Table 2 

Core Development of the North Carolina Test of Geometry 



Core 


Process 


IVICTWll 1 \Jt 

P-valuesfor 
AH rrems 


SD of 

P-vaiues of 
All Items 


Qi inri r\f 

\J\Ai 1 I \J\ 

P-vaiues of 
All Items 0 


1 


Design 


.602 


.199 


32.52 




Field Test 


.630 


.155 


37.77 


* 


Statewide Test 


.622 


.198 


37.29 




Equate 


.627 


.196 


37.60 


2 


" Design 


.£02 


' • .173 


32:50 




StatewideTest 


■; .642 


.172 


38.49 




Equate 


.627 


.170 


37.6.0 


3 


Design. 


.601 


.175 


33.03 




Statewide Test 


.624 


.171 


37.46 




Equate 


.627 


.173 


37.60 


4 


Resign 


- ' .'■ .6'00> '•' : . ' 


.185< 


32.97 




Statewide test 




.191 


37.33 




. Equate 


• -627 


.188 


37.60 


5 


Design 


.601 


.179 


33.63 




StatewideTest 


.604 


.177 


36.24 




Equate 


.627 


.183 


37.60 


6 


• Resign. , 


,:6G1 


.152 


33.64 




5tak^deTest 


.628 


.152 


37.69 




Equate 


.627 


.152 


37.61 


7 


Design 


,601 


.168 


33.04 




StatewideTest 


.622 


.169 


37.34 




Equate 


.627 


.171 


37.60 


8 






• ' ; .187 ' 


32.98 




Statefed^f est 




.184 


38.70 




/Equate' . ' 




.182 


37.60 



"Sum of p-values for Design Process based on all non-revised items. The number of revised or new items per 
form ranged from four to six. 
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Concunent validity of the test 



^2?w : *^* 1fc€ ^^ teachers were 

askedtoindiGate^ee^^ 

a^comp^son of lete grades iir. Geometry aiicfc tl^-me^^Cr-^oinetey core score 
corresr^no^g,toea^Ietter graded 

dosd r to : exr^faortandad^ * 




AnticijpatediGecmetry CburseGrade 



Figure 1. Comparisonof letter ^ades,teachersexpected J students.to 
receive andlSGoressubsequendy eanied-onitlre:6(Mtenv 
1989'North ^Carolina.Testor: Geometry— €bres 1-8' 
(N = 43-667). 



ERJC 



1.5 



NCT-Geometry 



Method for Deriving Test Scores 



Item information was available to support the classical scoring model and the Rasch scoring 
model. The classical scoringmodel gives.unitary weightioe^di item; a coireat choice adds one 
to the total score; an incorrect choice adds zero, the on^parameter Rasch model also uses 
unitary weighting, (The two- arid three-parameter item response models give more credit for 
answering some items correctly and less credit : for amwering oth^ items correctly. These 
models assume that each item has a fundamental, imchanging difficulty level.) 

The classical scoring model was utilized to score theNorth Carolina Test of Geometry because 
it is fundamentally sound, simple to use, and easy to interpret. Each student's score consists 
of tLe sum of the right answers to the 60 items. 
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Pliability and Other Statistics 

The descripti^ statistics, die standard en^p£m^ 

estimate^ and the alpha rehalbui# Oofc&d^ of the 

Normfcaroifoaf^ 

To determine file Mlefnate fofnrn^b&ty, a <*tt4pm Wffi^^ to 

partiapatemfraerl^ 

of AedghtNor&^alo^ 

criteria that was judged 16 be at leastpai^y 1^ 

perfbnnahce Oft the 1988 KO'-Aigebr* 1 ^i^-^tolv AHofed of.713 students 
schools Actually patfic^pated in the core ikid testing aivi we« »diTunis**mi Core J fe May 
1989. the agreement between the mean^Md *^l<^i) of^samjte group <mean * 
37.77 and s = 9.32) and the state norm mean (aggregated across Com t*«— see table 3) 
indicatesmatthefiddto^ 

population. Sample students' Scores oft tore 1 and me eight cores adm^fislered^aitewide 
were matched and ooltelajedjo otone^^ 
Carolina test of GeSfttefty . 

The alternate form r eliabilii - estimates Obtained from the small matched samples Were 
averagad through tfscOre transfcmatk>ft^ *:motestaote estimate of merelfcttlity. 

The average weijghted alternate fOrm^refiability Ot* ; the *s^43eOmetry is i83. The alpha 
reliability estimates have a mean value of .90. The 4989 oore scores are Symmetrically 
distiibuted about a mean of 37.B, or#25<& correct (see Figure '2). 
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Table 3 

Descriptive Statistics of the 1 989 North Carolina Test of Geometry 

v Reliability 

Core N Mean SD Median se^ 0 Alternate Coefficient 

Form b ~Alpha 



89/1-8 


43,325 


37.5 


10.3 


37 


4.25 


.83 




1 


5,630 


37.4 


9.85 


37 


3.27 




.89 


2 


5,588 


38.5 


10.06 


39 


3.18 




.90 


3 


5,552 


37.5 


10.36 


37 


3.28 




.90 


4 


5,446 


37.3 


10.03 


37' 


3.17 




.90 


5 


5,403 


36.2 


11.08 


36 


3.32 




.91 


6 


5,315 


37.7 


10.52 


38 


3.33 




.90 


7 


5,243 


37.3 


10.17 


37 


3.22 




.90 


8 


5,148 


38.7 


9.76 


38 


3.24 




.89 



a Based on the internal consistency estimate of reliability where available. 

b Matched samples of students administered Field Core 1 and one of the eight cores statewide 

(n m 713). Form 1, n » 90; Form 2,n = 87; Form 3,n = 88; Form 4, n = 82; Form n = 89; 

Form 6, n = 83; Form 7, n = 85; and Form 8, n = 77. 
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20 25 3IT — 35 3D *T 

Score on 60-item NCT-Geometry Core 



Figure 2. Frequency distribution of scores on the 1989 North Carolina 
Test of Geometry— Cores 1-8 (N = 43,325). 
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For practical purposes, the proper measure of reliability is the alternate form reliability- The 
calculation of this statistic requires that two or more equivalent forms of the test be developed. 
The older alternate form reliability procedure required, the development of one form, which 
was then "cloned" to obtain a second,* alternate form of the test A judicious selection of 
alternate items was recommended to prevent direct memory transfer from the administration 
of one test to its alternate form. But the possibility remainedlthat errors of selection in the first 
form would be duplicated in the second form. A newer procedure requires that the tests be 
truly equivalent— that is, that two or more tests be developed in exactly the same way, but 
independent of one another. This permits the reliability coeffident to reflect any random errors 
in selection made in the development of either of the test forms. 

The alternate forms developed for the North Carolina Test of Geometry reflect this newer 
procedure. That is, each test form is developed from the domain of items in exactly the same 
manner. Any failure of the alternate form reliability to be 1.00 reflects the following: 

• trait instability not following from maturation or instruction 

• instrument instability resulting from fallible test development procedures 

• administrative instability reflecting different testing occasions 

The square of the alternate form reliability coefficient accurately reflects the maximum 
proportion of variance one can legitimately expect to predict from the administration of the 
North Carolina Test of Geometry (r 2 = .83 2 = .69) when test scores are compared across time or 
with other measures of student abilities or personality traits that have similar reliabilities. In 
brief, the alternate form reliability coefficient is the statistic to use when correcting for 
attenuation. 
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Of special significance to the comparison of students scores across time is the equivalence of 
the core tests (Cores 1-8). While the initial equating process was successful, the eight cores 
were not exactly equivalent. Small random differences in item difficulty that generally occur 
between field testing and statewide testing were exhibited. These differences could be 
adjusted statistically by providing a separate set of norms for each test. A simple and efficient 
alternative is to redevelop the cores slightly so that even small differences are eliminated. With 
this technique, a single norms table can be used with all eight core tests. 

The eight North Carolina Test of Geometry cores were administered in May 1989. The item 
difficulties for all 480 items based on large random samples (approximately 5,400 students 
responded to each item on the eight forms) were available to the test developer. To accomplish 
the final equating, items were exchanged between core tests to yield total scores that were 
equivalent for all eight tests. A total of 24 items were exchanged, while maintaining all of the 
decisions concerning the design of the test that had been made previously (see Table 2). 

The adjustments to the core tests assure continuity of the norms table for future years while 
providing different test items each year. The typical administration procedure for the 
NCT-Geometry will be to administer four of the eight forms of the test per year (see Table 1). 
The different test items prevent the loss of confidentiality, and therefore validity, that occurs 
with the continued use of the same items. Students scores have a common reference point from 
1989 onward, barring Jhanges in the definition of the basic instructional program. 
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Curriculum Assessment 



TheNorth CarolinaTest of Geometry is composed of items representing the 55 basic objectives 
and five items representing the ten variable objectives, (as discussed earlier—see Table 1). All 
60 items contribute to the individual student scores and to curricular assessment. Items 
representing a variable objective were answered by half of the students. 

At the classroom level, 240 items are answered during each test administration by an average 
of six students. This procedure provides a database of approximately four items per objective 
across six students. From this databaseofiriformaiibn,evidenceof how various portions of the 
curriculum are being mastered in the classroom may be drawn. At the school, school district, 
and state level, the 240 items are answered by a much larger number of students: over 11,000 
students per item. This assures a more stable measurement, but does not include a larger 
number of objectives or items. The accumulation of item and objective information depends 
upon measurement across successive years. 

The measurement afforded by the ten variable objectives (five items per form, for a total of 20 
items) is critical to assessing curriculum mastery at the classroom, school, school district, and 
state levels. Each year of test administration adds to the database and gives a more detailed 
and comprehensive picture of curriculum success. 
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Content of The Test 



TheNorth CarolinaTest of Geometry is objective-referenced; that is, its reference is to a domain 
of objectives. This domain is mapped over a domain of items, where the items reflect the 
objectives,equalinkindahdnumb^ The Geometry tests were 

designed to achieve an even assessment across all objectives considered basic to instruction in 
Geometry; in short, each basic objective was represented by the same number of items. This 
design is consistent with the concept of a domain of objectives mapped over by a domain of 
items. Although the objectives have unit weighting, the goals are weighted by the number of 
objectives assigned to them. From empirical analyses, this is a traditional aspect of curriculum 
development: the more important a goal is considered to be, the greater number of objectives 
that will be developed for it. Thus, an underlying systfem of Wfeights exists for the curricular 
goals. 

Appendix A lists each goal and objective and the numerical item representation for each 
objective as it appeared on the 1989 North Carolina Test of Geometry (Cores 7 -8). In addition, 
the proportion of teachers rating each objective as basic to instruction in the Geometry 
curriculum is listed. 

Tables 4 through 11 list the difficulty level for all items on the 1989 North Carolina Test of 
Geometry (Cores 1-8) in terms of p-values (proportion of all students answering the item 
correctly). 
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Table 4 












Item Difficulty by Item Number for the 1989 NCT-Geometry 


-Core 1 




Item # 


P-value 


ltem# 


P-value 


ltem# 


P-value 


l 


.89 


21 


.59 


41 


.58 


2 


.89 


22 


.71 


42 


.42 


3 


.82 


23 


.55 


43 


.53 


4 


.82 


24 


.89 


44 


.35 


5 


.47 


25 


.57 


45 


.77 


6 


.62 


26 


.74 


46 


.36 


7 


.36 


27 


.67 


47 


.(51 


8 


.78 


28 


.86 


48 


.79 


9 


.87 


29 


.42 


49 


.55 


10 


.60 


30 


.51 


50 


,36 


11 


.36 


31 


.81 


51 


.37 


12 


.89 


32 


.63 


52 


.66 


13 


.29 


33 


.82 


53 


.44 


1 A 

14 


.95 


34 


.74 


54 


.42 


15 


.80 


35 


.56 


55 


.12 


16 


.87 


36 


.89 


56 


.73 


17 


.90 


37 


.91 


57 


.46 


18 


.54 


38 


.71 


58 


.36 


19 


.73 


39 


.45 


59 


.56 


20 


.52 


40 


.40 


60 


.45 ■ 
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Table 5 












Item Difficulty by Item Number for the .1989 NCT-&eometry 


— X^OTQx. 




ltem# 


P-value 


ltem# 


rP-yalue 


Item * 




l 


.59 


21 


.44 


•il 


.55 


2 


.90 


22 


.75 




•5U 


3 

' 4 


.27 


23 


♦58 


*kD 


.73 


.76 


24 


.69 


AA 


A A 

.44 


5 


.65 


25 


.40 


**D 


.55 


6 


.52 


26 


53 


AA 


.69 


7 


.44 


27 


.89 




.oU 


8 


.74 


28 


.86 


AO 


.86 


9 


.76 


29 


.43 


AO 


CO 

.52 


10 


.62 


30 


.42 


DU 


.69 


11 


.52 


31 


.45 


Di 


./6 


12 


.82 


32 


.95 


El 


.94 


13 


.94 


33 


:81 


CO 
DO 


PA 

.5U 


14 


.74 


34 


.61 


CA 

D*k 


.60 


15 


.72 


35 


.42 


DD 


rro 

.78 


16 


.85 


36 


.47 


DO 


•24 


17 


.71 


37 


.70 


57 


.62 


18 


.73 


38 


.75 


58 


.71 


19 


.93 


39 


.53 


59 


.47 


20 


.70 


40 


.53 


60 


.42 
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Table 6 

Item Difficulty by Item Number for the 1989 NCT-<5eometry— Core 3 



ltem# 


P-value 


ltem# 


P-value 


ltem# 


P-value 


1 


.64 


21 


.75 


41 


.51 


2 


.85 


22 


.55 


42 


50 


3 


.77 


23 


.73 


43 


.66 


4 


.81 


24 


.85 


44 


.54 


5 


.45 


25 


.61 


45 


.50 


6 


.62 


26 


.80 


46 


.44 


7 


.79 


27 


59 


47 


72 


8 


.61 


28 


59 


48 


78 


9 


.80 


29 


.45 


49 


.26 


10 


.51 


30 


.65 


50 


.53 


11 


.36 


31 


.67 


51 


49 


12 


.59 


32 


.97 


52 


.71 


13 


.86 


33 


.66 


53 


.40 


14 


.88 


34 


.57 


54 


.52 


15 


.89 


35 


.66 


55 


.55 


16 


.88 


36 


.38 


56 


.20 


17 


.97 


37 


.59 


57 


.71 


18 


.73 


38 


.55 


58 


.47 


19 


.48 


3? 


.46 


59 


.86 


20 


.57 


40 


.60 


60 


.37 
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Table 7 

Item Difficulty by Item Number for the 1989 NCT-Geometry-Core 4 



Item # P-value Item # 



1 


.74 


21 


2 


.36 


22 


3 


.26 


23 


4 


.90 


24 


5 


.84 


25 


6 


.52 


26 


7 


.70 


27 


8 


.93 


28 


9 


.58 


29 


10 


.63 


30 


ii 


.32 


31 


12 


.85 


32 


13 


.77 


33 


14 


.70 


34 


15 


.32 


35 


16 


.61 


36 


17 


.78 


37 


18 


.62 


38 


19 


.56 


39 


20 


.68 


40 



P-value Item # P-value 



.73 


41 


.42 


.88 


42 


.53 


.54 


43 


-?j 


.91 


44 


.44 


.76 


45 


.77 


.85 


46 


.50 


.92 


47 


.83 


f5 


48 


.50 


68 


49 


.84 


.43 


50 


.72 


.44. 


51 


.28 


.81 


52 


.95 


.38 


53 


.47 


.47 


54 


-57 


.53 


55 


.35 


33 


56 


.41 


.79 


57 


.55 


.86 


58 


.73 


.64 


59 


? 52 


.78 


60 


.34 
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Item Difficulty by Item Number for the 1989 NCT-Geometry 


—Core 5 




ltem# 


P-value 


ltem# 


P-value 


ltem# 


P-value 


1 


.52 


21 


.46 


41 


.42 


2 


.69 


22 


.44 


42 


.58 


3 


.59 


23 


.49 


43 


.39 


4 


.85 


24 


.73 


44 


.52 


5 


.63 


25 


.73 


45 


.45 


6 


.92 


26 


.56 


46 


.65 


7 


.89 


27 


.68 


47 


.90 


8 


.78 


28 


.62 


48 


.42 


9 


.89 


29 


.61 


49 


.59 


10 


.53 


30 


.50 


50 


.81 


11 


.51 


31 


.42 


51 


.39 


12 


.85 


32 


.68 


52 


.74 


13 


.77 


33 


.82 


53 


.39 


14 


.75 


34 


.61 


54 


.51 


15 


53 


35 


.89 


55 


.39 


16 


.75 


36 


.51 


56 


.32 


17 


.43 


37 


.78 


57 


.51 


18 


.75 


38 


.55 


58 


.38 


19 


.74 


39 


.51 


59 


.48 


20 


.91 


40 


.39 


60 


.14 
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Table 9 

Item Difficulty by Item Number for the I V89 NCT-Geometry-Core 6 



ltem# P-value item# P-vdlue Item* P-value 



•f 

1 


.51 


21 


.76 


41 


.51 


2 


.52 


22 


.60 


42 


.58 


3 


.48 


23 


.66 


43 


.53 


A 

4 


(HI 

.77 


24 


.64 


44 


.44 


c 
D 


.34 


25 


.64 


45 


.63 


0 


.74 


26 


.62 


46 


.31 


/ 


.78 


27 


.69 


47 


.61 


of 
o 


.87 


28 


.59 


48 


.73 


Q 


.89 


29 


.57 


49 


.81 


iU 


.63 


30 


.65 


50 


.65 


1 1 
i i 


.78 


31 


.52 


51 


.50 


12 


.57 


32 


.89 


52 


.45 


13 


.92 


33 


.81 


53 


.68 


14 


.80 


34 


.70 


54 


.70 


15 


.50 


35 


.93 


55 


.67 


16 • 


.52 


36 


.52 


56 


.32 


17 


.53 


37 


.86 


57 


.52 


18 


.78 


38 


.41 


58 


.88 


19 


.54 


39 


.47 


59 


.50 


20 


.67 


40 


.54 


'O 


.46 
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Table 10 












Item Difficulty by Item Number for the 1989 NCT-Geometry 


—Core 7 




Item # 


P-value 


item # 


r-vaiue 


ltem# 


P-value 


l 


.81 


21 


•76 


41 


.58 


2 


.81 


22 


.71 


42 


.83 


3 


.82 


23 


n ft 

.37 


43 


.43 


4 


.53 


24 


.79 


44 


.46 


5 


.76 


25 


.79 


45 


.50 


6 


.91 


26 


.87 


46 


.66 


7 


.75 


27 


.57 


47 


.31 


8 


.34 


28 


.65 


48 


.55 


9 


.91 


29 


.43 


49 


.93 


10 


.51 


30 


.81 


50 


.75 


11 


.59 


31 


.46 


51 


.35 


12 


.52 


32 


.55 


52 


.41 


13 


.90 


33 


.65 


53 


.51 


14 


.77 


34 


/A 

.69 


54 


.53 


15 


.60 


35 


.39 


55 


.60 


16 


.70 


36 


.55 


56 


.50 


17 


.90 


37 


.39 


57 


.84 


18 


.71 


38 


.44 


58 


.63 


19 


.61 


39 


.46 


59 


.48 


20 


.73 


40 


.55 


60 


.43 
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Table 11 

Hem Difficulty by Item Number for the 1989 NOMSeometry— Core 8 



item w 


P-value 


Item # 


P-value 


ltem# 


P-value 


1 


.54 


21 


.71 


41 


.55 


2 


.49 


22 


.81 


42 


.75 


3 


.88 


23 


.56 


43 


.51 


A 

4 


.89 


24 


.84' 


44 


.51 


c 
o 


no 

.82 


25 


.49 


45 


.37 


o 


.33 


26 


.74 


46 


.41 


/ 


.40 


27 


.47 


47 


.69' 


Q 

O 


.87 


28. 


.67 


48 


.51 


y 


.91 


29 


.36 


49 


.53 


1U 


.61 


30 


.88 


50 


.50 


11 


AO 

.48 


31 


.43 


51 


.55 


12 


or* 

.85 


. 32 


.94' 


52 


.52 


13 


.90 


33 


.66 


53 


.83 


14 


.92 


34 


.85 


54 


.54 


15 


.90 


35 


.50 


55 


.53 


16 


.94 


36 


.45 


56 


.58 


17 


.89 


37 


.64 


57 


.85 


18 


.70 


38 


.53 


58 


.45 


19 


.83 


39 


.53 


59 


.63 


20 


.82 


40 


.58 


60 


.28 
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Test Norms 



Students who answer all 60 of the Geometry items cpnrectly could be assumed to be excellent 
Geometry students. If everyone answered all of the items correctly, however, a different 
interpretation would be placed on the scores. At some point, scores must have a reference 
group grounded in the experience of all students. In some respect, everything is good or bad 
by comparison. Norms tables provide this reference. Given a norms table, a student's score 
can be compared with uiher students' scores. 

Norms tables commonly have two points of reference: a scale of percentiles and a scale of 
standard scores. The former permits the location of a score within percentile ranks; thus a 
student is said to haveexceeded the performance of 80% of the students in the norm group (in 
this case, Geometry students who took the North Carolina Test of Geometry in May 1989). The 
latter, standard scores, permits the location of a score within normally-distributed standard 
scores. This reference is appropriate if the student abilities are believed to be normally 
distributed. In a normal distribution, raw scores are given greater and greater weight as they 
diverge from the mean in either direction. 

The choice of a metric for the standard score is arbitrary. To avoid inappropriate and confusing 
comparisons with some of the more common metrics, such as those employed in IQ scores or 
NCE scores, a metric having a mean of 50 and a standard deviation of 10 was chosen. Most 
curriculum research studies involving the summation of scores will find the standard score to 
be the most useful statistic. 

The norms table for student scores on the North Carolina Test of Geometry is given in Table 
12. These scores set a baseline of comparison for present and future achievement in Geometry. 
Thus, a student score in 1990, 1991, and future years, can be referenced to the scores of all 1989 
Geometry students in North Carolina. 

In summary, the utility of a test is determined by its statistical equivalence of core tests from 
year to year, its broad sampling of the curriculum across time, and its initial norms table. 
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Table 12 

Norms for Student Scores on the North Carolina Test of Geometry 


Raw Score 


Percentile 


Standard Sf*ore> a 


6U 


99 


71.8 


CO 


99 


70.9 


DO 


99 


69.9 


D/ 


98 


68.9 


00 


97 


68.0 


00 


96 


67.0 


0*t 


94 


66.0 


DO 


93 


65.0 


R9 
DZ 


91 


64.1 


C1 
Dl 


89 


63.1 


cn 
DU 


87 


621 


49 


85 


61.2 


48 


82 


60.2 


Art 

47 


80 


59.2 


46 


77 


58.3 


/IE 

45 


74 


57.3 


44 


71 


56.3 


*±o 


68 


55.3 


AO 


65 


54.4 


/11 


62 


53.4 


W 


59 


52.4 




55 


51.5 


oo 


52 


50.5 


0/ 


49 


49.5 


00 


45 


48.5 


00 


42 


47.6 


d4 


38 


46.6 


o5 


35 


45.6 


io 


32 


44.7 




28 


43.7 


on 


25 


42.7 




22 


41.7 


OQ 


20 


40.8 


// 


17 


39.8 


o£ 
Zo 


15 


38.8 




12 


37.9 


24 


10 


369 


23 


8 


35.9 


22 


7 


35.0 


21 


5 


34.0 


20 


4 


33.0 


19 


3 


32.0 


Less Than 19 


2 





'Adjusted to a mean of 50 and a standard deviation of 10.0. 
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Appendix A 

Test Content— Item Representation by Goal dfid Objective 

%6f TeQghfefs 

No. Ifeffis Repffing 

Goal/Obj Description 1^9 a$.§asiG a 

Goal 1 The learner will state the character isfics df &ts 
of points. 

1.3 Identify and name unions and interseiftibfts of 8 91.08 
sets of points. 

1.5 Find the length of a segment. 8 9^.39 

1.7 Identify the midpoint 6f a given segment- 8 99i09 

1.9 Determine when two angles are Congruent 8 9&70 

1.10 Identify interiors and texteridrs of geiSm^fic § 9&§3 
figures. 

1.11 Identify the bisector of an angle. 8 9&39 



Goal 2 The learner will use the stnictural prbpefties of 
the real number. 

2.1 State and use the properties of equality; 8 96.04 

2.2 State and use the properties of inequality. 8 86.28 



Goal 3 The tearner will develop geometric proofs. 

3.1 Translate a geometric statement into ah '"if- $ 94.21 
Then Statement/' 

3.2 State the converse of a conditional statement. 8 92.3)8 

3.3 State the hypothesis and condiisioh for a 8 94,80 
conditional statemeh't. 

3.4 Use the process of d^U(Mvere^niftgih 8 84.31 
mathematical and hoh-mathematicai situations. 



•Percentage of North Carolina Geometry teachers rating the objective as basic to instruction in Geontetiy. 
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Goal/Obj Description 



Goal 4 The learner will use some of the properties of 
angles and lines to develop proofs and solve 
exercises. 

4.2 Classify an angle. 8 100.00 

4.3 Identify adjacent and vertical angles. 8 99.69 

4.4 Determine foe complement, and supplement of 8 99.69 
a given angle. 

4.5 Apply the Angle Addition Postulate. 8 96.31 

4.6 Apply the Segment Addition Postulate. 8 92.28 
(Definition of Itetweenness) 



Goal 5 The learner will recognize perpendicular lines 
and planes and use this information to 
complete proofs and exercises. 

5.1 Apply definitions of perpendicular lines and 8 98.78 

planes. 



Goal 6 The learner will recognize parallel lines ar d 
planes and use this knowledge to complete 
proofs and exercises. 

6.1 Identify parallel lines and planes, and skew 8 99.70 
lines. 

6.2 Identify corresponding angles and alternate 8 99.09 
interior; angles which are formed when two 

parallel lines are cut by a transversal. 

6.3 State conditions under vhich lines are parallel. 8 98.17 

6.4 State which angles are congruent when two 8 98.78 
parallel lines are cut by a transversal. 

6.5 Identify which angles ars supplementary when 8 97.57 
two parallel lines are cut by a transversal. 
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Goal/Obj Description 



% of Teachers 
No. Items Reporting 
1989 as Basic 0 



Goal 7 The learner .will identify polygons and 

complete proofs and exercises related to them. 



7.1 
7.2 
7.3 

7.4 

7.5 

7.6 

7.7 

7.8 



Classify a triangle according to its sides. 
Classify a triangle according to its angles. 
Classify a polygon according to the number of 
its sides or angles. 

Classify a convex polygon according to the 
measure of its angles. 

Apply the fact that the sum of the measures of 

the angles of a triangle is 180. 

Find the measures of the exterior angles of a 

triangle. 

Find the measures of the interior and exterior 
angles of a convex polygon. 
Apply the characteristics of various 
quadrilaterals. 



8 
8 
8 

4 

8 

8 

8 

8 



99.39 
99.39 
98.47 

74.77 

99.69 

96.32 

90.21 

92.00 



Goal 8 



8.1 



8.2 



8.3 
8.4 

8.5 



The learner will identify congruent triangles 
and complete proofs and exercises related to 
them. 

List the corresponding parts of two congruent 
triangles. 

Use various postulates and theorems to prove 
two triangles are congruent and their 
corresponding parts are congruent. 
Identify the altitudes and medians of triangles. 
Apply the theorem about, the segment joining 
the midpoints of two sides of a triangle. 
Apply the theorem about the intersection of the 
medians of a triangle. 



8 

8 



8 
8 



99.39 
96.95 



96.94 
87.16 

57.19 



"Percentage of North Carolina Geometry teachers rating the objective as basic to instruction in Geometry. 
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Goal/Obj Description 



% of Teachers 
No. Items Reporting 
1989 asBasic 0 



Goal 9 rhe learner will demonstrate when two 

polygons are similar and develop proofs and 
solve exercises related to them. 



9.1 


Identify regular polygons and determine the 


•8 


98.78 




measures of the angles. 






9.2 


Solve a proportion. 


8 


99.03 


9.3 


Use proportions to solve geometric problems. 


8 


97.08 


9.4 


Find 'che geometric mean of two numbers. 


8 


93.20 


9.5 


Determine whether or not two polygons are 


8 


94.16 




similar. 




9.6 


Prove two triangles are similar. 


8 


93.19 


9.7 


Apply properties of similar triangles to find 


8 


94.89 


9.8 


corresponding proportional sides. 






Apply theorems which involve dividing 


8 


79.56 




segments proportionally. 







Goal 10 The learner will state some of the characteristics 
of a right triangle and solre exercises related to 
them. 

10.1 State two relationships that exist in a right 8 95.57 
triangle. 

10.2 Use the Pythagorean Theorem and its converse 8 99.51 
to find the lengths of the sides of a right 

triangle or a quadrilateral. 

10.3 Use the relationships that exist in special right 8 95.63 
triangles to solve problems. 



Goal 1 1 The learner will list some characteristics of a 
circle and develop proofs and solve exercises 
related to them. 

11.1 Use the definitions of a circle and the lines and 8 98.29 
segments related to it. 

11.2 Recognize polygons inscribed in or 8 
circumscribed about a circle. 



91.50 
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Goal/Obj Description 



% of Teachers 
No. Items Reporting 
1989 as Basic 0 



11.3 Apply the properties involving arcs and angles 8 95.87 
of circles. 

11.4 Apply the theorems about the chords of a circle. 8 94.17 
115 Apply the theorems that relate to the tangents, 8 90.29 

secants, and radii of a drde. 



Goal 12 The learner will find the perimeter, area, and 
volume of geometric figures. 

12.1 Find the perimeter of a geometric figure. 8 99.03 

12.2 Compute the area of a triangle, parallelogram, 8 97.82 
trapezoid, and rectangle. 

12.3 Find the ratio of bofih the areas and the 4 66.91 
perimeters of similar-triangles. 

12.4 Compute the apothem, radius, and area of 4 72.57 
special regular polygons. 

12.6 Compute arc lengths and the areas of sectors of 4 74.27 
a circle. 

12.7 Identify and describe space figures. 4 54.00 

12.8 Compute the lateral area, total area, and 4 57.87 
volume of a right prism or pyramid. 

12.9 Compute the lateral area and volume of aright 4 57.42 
circular cylinder or cone. 



Goal 14 The learner will investigate some of the 
properties of coordinate geometry. 

14.1 Write the coordinates for a point in the 8 78.10 
coordinate plane. 

14.2 Write equations Jot vertical and horizontal lines 4 71.53 
in the coordinate plane. 

14.3 Use me distance formula to solve problems. 8 75.37 

14.4 Use me midpoint formula to find the 8 75.43 
coordinates of the midpoint or endpoint of a 

segment. 

14.7 Write an equation for a line which is parallel or 4 56.45 
perpendicular to a given line. 
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Goals and Objectives Rejected for Use 



% of Teachers 
Reporting 

Goal/Obj Description as Basic 0 



Goal 1 The learner will state the characteristics of sets of 
points. 

1.1 Identify and name sets of points, such as line, ray, 99.79 
segment, and plane. 

1 .2 Draw representations of points, lines, and planes. 99.39 
1 .4 Find the coordinate of a point on a line. 97.87 
1.6 Identify congruent segments. 99.73 
1.8 Use a protractor to find the measure of an angle. 87.20 



Goal 3 The learner will develop geometric proofs. 

Write a proof using the two-column format. 96.32 
3.6 Write an indirect proof. 59.20 



Goal 4 The learner will use some of die properties of angles 
and lines to develop proofs and solve exercises. 

4.1 Use three letters, a number, or a single letter to name 100.00 
an angle. 

4.7 Recognize congruent angles. 99.08 



Goal 10 The learner will state some of the characteristics of a 
right triangle and solve exercises related to them. 

10.4 Use a table and/or calculator to apply the definitions 76.94 
of sine, cosine, and tangent to solve right triangles. 
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Goal/Obj Description 



%.ofTeacheis 
^Reporting 
asBasic a 



Goal 12 The learner will find the perimeter, area, and volume 
of geometric figures. 

12.5 Compute me circumference and area of a circle 96.61 



Goal 13 The learner will complete a geometric construction 
and describe the locus of a point or points. 

13.1 Construct a segment congruent to a given segment. 74.94 

13.2 Construct an angle congruent to a given angle. 73.61 

13.3 Construct the bisector of an angle. 74.33 

13.4 Conjitmctalineperpenm'culartoalinemrougha 73.61 
point on the line. 

13.5 Construct a line perpendicular to a line through a 73.54 
point not on the line. 

13.6 Construct the perpendicular bisector of a segment 72.64 

13.7 ConstmctahneparaUeltoalinemroughagiven 68.93 
point 

13.8 Construct the tangents to a circle from a point outside 48.43 
the circle. 

13.9 Circumscribe a circle about a triangle. 49.27 

13.10 Inscribe a circle inside a triangle. 48.18 

13.11 Divide a segment into a gi en number of congruent 4532 
segments. 

13.12 Given three segments, construct a fourth segment 26.65 
such that the lengths of the four segments are 

proportional. 

13.13 Construct a segment whose length is the geometric 24.02 
mean between the lengths of two given segments. 

13.14 Construct quadrilaterals which meet certain criteria. 27.21 

13.15 Construct a circle through three non-collinear points. 23.04 
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Goal/Obj Description 



% of Teachers 
Reporting 
as Basic 0 



Goal 14 The learner will investigate some of the properties of 
coordinate geometry. 

145 Find the slope of the line given two points on the line. 
14.6 Find the slope and yr-intercept of a line. 

14.8 Write the equation and draw the graph of line when 
given either two points on the line, one point and the 
jlope of the line, or the slope and y-intercept of the 
line. 

14.9 Use coordinate geometry to prove some of the 
properties of polygons. 

14.10 Write an equation of a circle given its center and 
radius length. 

14.1 1 Find the center and radius length of a circle given an 
equation. 
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